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Abstract 

For every fixed finite field W q , p G (0, 1 — 1/q) and e > 0, we prove that with high probability 
a random subspace C of F™ of dimension (1 — H q (p) — e)n has the property that every Hamming 
ball of radius pn has at most 0(1/ e) codewords. 

This answers a basic open question concerning the list-decodability of linear codes, showing 
that a list size of 0(1/ e) suffices to have rate within e of the "capacity" 1 — H q (p). This matches 
up to constant factors the list-size achieved by general random codes, and gives an exponential 
improvement over the best previously known list-size bound of q ^ 1 /^ . 

The main technical ingredient in our proof is a strong upper bound on the probability that I 
random vectors chosen from a Hamming ball centered at the origin have too many (more than 
&(£)) vectors from their linear span also belong to the ball. 
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1 Introduction 



One of the central problems in coding theory is to understand the trade-off between the redundancy 
built into codewords (aka the rate of the code) and the fraction of errors the code enables correcting. 
Suppose we are interested in codes over the binary alphabet (for concreteness) that enable recovery 
of the correct codeword c E {0, l} n from any noisy received word r that differs from c in at most 
pn locations. For each c, there are about ("^ « 2 H ^> n such possible received words r, where 
H(x) = — xlog 2 x — (1 — x)log 2 (l — x) stands for the binary entropy function. Now for each 
such r, the error-recovery procedure must identify c as a possible choice for the true codeword. In 
fact, even if the errors are randomly distributed and not worst-case, the algorithm must identify c 
as a candidate codeword for most of these 2 H ^ n received words, if we seek a low decoding error 
probability. This implies that there can be at most ~ 2 <yl ~ H<yP ^ n codewords, or equivalently the 
largest rate R of the code one can hope for is 1 — H(p). 

If we could pack about 2^ l ~ H ^ n pairwise disjoint Hamming balls of radius pn in {0, l} n , then 
one can achieve a rate approaching 1 — H(p) while guaranteeing correct and unambiguous recovery 
of the codeword from an arbitrary fraction p of errors. Unfortunately, it is well known that such 
an asymptotic "perfect packing" of Hamming balls in {0, l} n does not exist, and the largest size 
of such a packing is at most 2^ a ^ +0<yl ^ n for a(p) < 1 — H(p) (in fact a(p) = for p ^ 1/4). 
Nevertheless, it turns out that it is possible to pack 2^~ H ^~ £ ^ n such Hamming balls such that no 
0(1/ e) of them intersect at a point, for any e > 0. In fact a random packing has such a property 
with high probability. 

List Decoding. This fact implies that it is possible to achieve rate approaching the optimal 
1 — H(p) bound for correcting a fraction p of worst-case errors in a model called list decoding. 
List decoding, which was introduced independently by Elias and Wonzencraft in the 1950s [Eli57, 
Woz58], is an error-recovery model where the decoder is allowed to output a small list of candidate 
codewords that must include all codewords within Hamming distance pn of the received word. 
Note that if at most pn errors occur, the list decoder's output will include the correct codeword. 
In addition to the rate R of the code and the error fraction p, list decoding has an important third 
parameter, the "list-size," which is the largest number L of codewords the decoder is allowed to 
output on any received word. The list-size thus bounds the maximum ambiguity in the output of 
the decoder. 

For codes over an alphabet of size q, all the above statements hold with H(p) replaced by H q (p), 
where H q (x) = x log„(q — 1) — x log q x — (1 — x) log„(l — x) is the g-ary entropy function. 

Definition 1 (Combinatorial list decodability property). Let £ be a finite alphabet of size q, L ^ 1 
an integer, and p 6 (0, 1 — 1/q). A code C C T, n is said to be (p, L)-list-decodable, if for every 
x G Ti n , there are at most L codewords of C that are at Hamming distance pn or less from x. 
Formally, \Bn(x,p) n C\ ^ L for every x, where B%,(x,p) C T, n is the ball of radius pn centered at 
x G {0, l} n . 

We restrict p < 1 — 1/q in the above definition since a random string differs from each codeword 
in at most a fraction 1 — 1/q of positions, and so over alphabet size q decoding from a fraction 
1 — 1/q or more errors is impossible (except for trivial codes). 

Combinatorics of list decoding. A fundamental question in list decoding is to understand 
the trade-off between rate, error-fraction, and list-size. For example, what list-size suffices if we 



2 



want codes of rate within e of the optimal 1 — H q (p) bound? That is, if we define L q ^ p (e) to be the 
minimum integer L for which there are q-aiy (p, L)-list-decodable codes of rate at least 1 — H q (p) — e 
for infinitely many lengths n, how does L q ^ p (e) behave for small e (as we keep the alphabet size q 
andpG (0,1- 1/q) fixed)? 

It is known that unbounded list-size is needed as one approaches the optimal rate of 1 — H q (p). 
In other words, L qtP (e) — > oo as e — > 0. This was shown for the binary case in [BH86], and his 
result implicitly implies L2, p (e) ^ ri(log(l/e)) (see [Rud09] for an explicit derivation of this). For 
the q-aiy case, L 9iP (e) = oj £ (1) was shown in [Bli05, Bli08]. In the language of list-decoding, 
the above-mentioned result on "almost-disjoint" sphere packing states that for large enough block 
lengths, a random code of rate 1 — H q (p) — e is (p, -)-list-decodable with high probability. In other 
words, L q:P {e) ^ 1/e. This result appears in [Eli91] (and is based on a previous random coding 
argument for linear codes from [ZP82]). The result is explicitly stated in [Eli91] only for q = 2, but 
trivially extends for arbitrary alphabet size q. This result is also tight, in the sense that with high 
probability a random code of rate 1 — H q {p) — e is not (p, c Pj(? /e)-list-decodable w.h.p. for some 
constant c PA > [Rud09]. 

An interesting question is to close the exponential gap in the lower and upper bounds on L2 iP (e), 
and more generally pin down the asymptotic behavior of L q ^ p (e) for every q. The upper bound of 
0(1 je) is perhaps closer to the truth, and it is probably the lower bound that needs strengthening. 

Context of this work. In this work, we address another fundamental combinatorial question 
concerning list-decodable codes, namely the behavior of L qtP (e) when restricted to linear codes. For 
q a prime power, a g-ary linear code is simply a subspace of ¥ q (¥ q being the field of size q). 

Most of the well-studied and practically used codes are linear codes. Linear codes admit a 
succinct representation in terms of its basis (called generator matrix). This aids in finding and 
representing such codes efficiently, and as a result linear codes are often useful as "inner" codes in 
concatenated code constructions. 

In a linear code, by translation invariance, the neighborhood of every codeword looks the same, 
and this is often a very useful symmetry property. For instance, this property was recently used 
in [GS09] to give a black-box conversion of linear list-decodable codes to codes achieving capacity 
against a worst-case additive channel (the linearity of the list-decodable code is crucial for this 
connection) . Lastly, list-decodability of linear codes brings to the fore some intriguing questions on 
the interplay between the geometry of linear spaces and Hamming balls, and is therefore interesting 
in its own right. For these and several other reasons, it is desirable to achieve good trade-offs for 
list decoding via linear codes. 

Since linear codes are a highly structured subclass of all codes, proving the existence of linear 
codes with list-decodability properties similar to general codes can be viewed as a strong "de- 
randomization" of the random coding argument used to construct good list-decodable codes. A 
derandomized family of codes called "pseudolinear codes" were put forth in [GI01] since linear 
codes were not known to have strong enough list-decoding properties. Indeed, prior to this work, 
the results known for linear codes were substantially weaker than for general codes (we discuss the 
details next). Closing this gap is the main motivation behind this work. 

Status of list-decodability of linear codes. Zyablov and Pinsker proved that a random binary 
linear code of rate 1 — H(p) — e is (p, 2°( 1//£ ))-list-decodable with high probability [ZP82]. The 
proof extends in a straightforward way to linear codes over ¥ q , giving list-size q ^ 1 /^ for rate 
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1 — H q (p) — e. Let us define L q n p (e) to be the minimum integer L for which there is an infinite 
family of (p, L)-list-decodable linear codes over ¥ q of rate at least 1 — H q {p) — e. The results of 
[ZP82] thus imply that L y q m p {e) SC exp(O ff (l/e)). 

Note that this bound is exponentially worse than the 0(l/e) bound known for general codes. 
In [EH91], Elias mentions the following as the most obvious problem left open left by the random 
coding results: Is the requirement of the much larger list size for linear codes inherent, or can one 
achieve list-size closer to the 0(1/ e) bound for general random codes? 

For the binary case, the existence of (p, L)-list-decodable linear codes of rate at least 1 — H(p) — 
1/L is proven in [GHSZ02]. This implies that L^" p 1/e. There are some results which obtain 
lower bounds on the rate for the case of small fixed list-size (at most 3) [Bli86, Bli97, WF94]; these 
bounds are complicated and not easily stated, and as noted in [BliOO], are weaker for the linear 
case for list-size as small as 5. 

The proof in [GHSZ02] is based on a carefully designed potential function that quantifies list- 
decodability, and uses the "semi-random" method to successively pick good basis vectors for the 
code. The proof only guarantees that such binary linear codes exist with positive probability, and 
does not yield a high probability guarantee for the claimed list-decodability property. Further, the 
proof relies crucially on the binary alphabet and extending it to work for larger alphabets (or even 
the ternary case) has resisted all attempts. Thus, for q > 2, Lq iP (e) ^ exp(O q (l/e)) remained the 
best known upper bound on list-size. A high probability result for the binary case, and an upper 
bound of Lg tP (e) ^ 0(1/ e) for F g -linear codes, were conjectured in [Gur04, Chap. 5]. 

Our contribution. In this work, we resolve the above open question concerning list-decodability 
of linear codes over all alphabets. In particular, we prove that L q " p (e) ^ C q ^ p /e for a constant 
Cq )P < oo. Up to constant factors, this matches the best known result for general, non-linear codes. 
Further, our result in fact shows that a random F 9 -linear code of rate 1 — H q (p) —e is (p, C Pi9 /e))-list- 
decodable with high probability. This was not known even for the case q = 2. The high probability 
claim implies an efficient randomized Monte Carlo construction of such list-decodable codes. 

We now briefly explain the difficulty in obtaining good bounds for list-decoding linear codes 
and how we circumvent it. This is just a high level description; see the next section for a more 
technical description of our proof method. 

Let us recall the straightforward random coding method that shows the list-decodability of 
random (binary) codes. We pick a code C C {0, 1}" by uniformly and independently picking 
M = 2 Rn codewords. To prove it is (p, L)-list-decodable, we fix a center y and a subset S of (L + 1) 
codewords of C. Since these codewords are independent, the probability that all of them land in 
the ball of radius pn around y is at most ( 2 ) L+1 ■ A union bound over all 2 n choices of y and at 
most M L+1 choices of S shows that if R ^ 1 — H(p) — 1/L, the code fails to be (p, L)-list-decodable 
with probability at most 2~ n ^ . 

Attempting a similar argument in the case of random linear codes, defined by a random linear 
map A : ¥ Rn — > faces several immediate obstacles. The 2 Rn codewords of a random linear code 
are not independent of one another; in fact the points of such a code are highly correlated and 
not even 3- wise independent (as A(x + y) = Ax + Ay). However, any (L + 1) distinct codewords 
Axi, Ax2, ■ ■ ■ , Axl+i must contain a subset of £ ^ \og 2 (L+l) independent codewords, corresponding 
to a subset {x^ , . . . , Xi e } of linearly independent message vectors. This lets one mimic the argument 
for the random code case with log 2 (£ + 1) playing the role of L + 1. However, as a result, it leads 
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to the exponentially worse list-size bounds. 

To get a better result, we somehow need to control the "damage" caused by subsets of codewords 
of low rank. This is the crux of our new proof. Stated loosely and somewhat imprecisely, we prove 
a strong upper bound on the fraction of such low rank subsets, by proving that if we pick £ random 
vectors from the Hamming ball B n (0,p) (for some constant t related to our target list-size L), it 
is rather unlikely that more than 0(^) of the 2 £ vectors in their span will also belong to the ball 
B n (0,p). (See Theorem 3 for the precise statement.) This "limited correlation" between linear 
subspaces and Hamming balls is the main technical ingredient in our proof. It seems like a basic 
and powerful probabilistic fact that might find other applications. The argument also extends to 
linear codes over ¥ q after some adaptations. 

2 Results and Methods 

Our main result is that random linear codes in FJ? of rate 1 — H(p) — e can be list-decoded from 
p- fraction errors with list-size only O(^). We also show the analogous result for random q-avy linear 
codes. 

Theorem 2. Let p £ (0, 1/2). Then there exist constants C p , 5 > 0, such that for all e > and all 
large enough integers n, letting R = 1 — H{p) — e, ifC C is a random linear code of rate R, then 

Pr[C is (p, ^f)-list-decodable] > 1 - 2~ <5n . 

The proof begins by simplifying the problem to its combinatorial core. Specifically, we reduce 
the problem of studying the list-decodability of a random linear code of linear dimension to the 
problem of studying the weight- distribution of certain random linear codes of constant dimension. 
The next theorem analyzes the weight distribution of these constant-dimensional random linear 
codes. The notation B n (x,p) refers to the Hamming ball of radius pn centered at x E F^. 

Theorem 3 (Span of random points in B n (0,p)). For every p £ (0,1/2), there is a constant 
C > 0, such that for all n large enough and all I = o(^/n), if X±, . . . ,Xj> are picked independently 
and uniformly at random from B n (0,p), then 

Pr[|span({X 1 ,...,X4)nB n (0,p)| > C ■ £} ^2~ 5n . 

We now give a brief sketch of the proof of Theorem 3. Index the elements of span({Xi, . . . , X{\) 
as follows: for v E Fg, let X v denote the random vector Yli=i v i^i- Fix an arbitrary 5 C Fj of 
cardinality C and let us study the event E$'- that all the vectors (X v ) v< =s he in B n (0,p). If none 
of the events Eg occur, we know that |span({Xi, . . . , X{\) n B n (0,p)\ ^ C • I. 

The key technical step is a Ramsey-theoretic lemma (Lemma 5, stated below) which says that 
large sets S automatically have the property that some translate of S contains a certain structured 
subset (which we call an "increasing chain"). This structured subset allows us to give strong upper 
bounds on the probability that all the vectors (X v ) ve s he in B n (0,p). Applying this to each S C F| 
of cardinality Ct and taking a union bound gives Theorem 3. 

To state the Ramsey-theoretic lemma (Lemma 5), we first define increasing chains. For a vector 
v £ F|, the support of v, denoted supp(t> ), is defined to be the set of its nonzero coordinates. 
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Definition 4. A sequence of vectors V\, . . . , Vd G F| is called an c-increasing chain of length d, if 
for all j G [d], 

supp(^) \ I (J supp(* 

Vi=i 



> c. 



We now state the Ramsey-theoretic lemma that plays the central role in Theorem 3. The proof 
appears in Section 5, where it is proved using the Sauer-Shelah lemma. 

Lemma 5. For all positive integers c,£ and L ^ 2 , the following holds. For every S C F| 
with \S\ = L, there is a w G F| such that S + w has an c-increasing chain of length at least 
I(logf)-(l-i)(logf). 



2.1 Larger alphabet 

Due to their geometric nature, our arguments generalize to the case of q-avy alphabet (for arbitrary 
constant q) quite easily. Below we state our main theorem for the case of (/-ary alphabet. 

Theorem 6. Let q be a prime power and letp£ (0, 1 — 1/q). Then there exist constants C Pj9 , 5 > 0, 
such that for all e > 0, letting R = 1 — H q (p) — e, ifC C F™ is a random linear code of rate R, then 

Pr[C is (p, ^)-list-decodable] > 1 - 2~ Sn . 



The proof of Theorem 6 has the same basic outline as the proof of Theorem 2. In particular, 
it proceeds via a g-ary analog of Theorem 3. The only notable deviation occurs in the proof 
of the (?-ary analog of Lemma 5. The traditional generalization of the Sauer-Shelah lemma to 
larger alphabets turns out to be unsuitable for this purpose. Instead, we formulate and prove a 
non-standard generalization of the Sauer-Shelah lemma for the larger alphabet case which is more 
appropriate for this situation. Details appear in Section 6. 



3 Proof of Theorem 2 

Let us start by restating our main theorem. 

Theorem 2 (restated) Let p G (0, 1/2). Then there exist constants C p ,5 > 0, such that for all 
e > and all large enough integers n, letting R = 1 — H(p) — e, i/C C Fj is a random linear code 
of rate R, then 

Pr[C is (p, ^f)-list-decodable] > 1 - 2~ <5n . 



Proof. Pick C p = 4C, where C is the constant from Theorem 3. Pick 5 = 1. Take L = 
Let C be a random Rn dimensional linear subspace of FJ? . We want to show that 

Pv[3x G Fg s.t. \B n {x,p) n C\ > L] < 2~ 5n . (1) 
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Let x S F?j be picked uniformly at random. We will work towards Equation (1) by studying the 
following quantity. 

A d = Pi[\B n (x,p)nC\ > L]. 

C,x 

Note that to prove Equation (1), it suffices to show that 1 

A < T hl • 2~ n . 



Now for each t & [log(L + 1), L + 1], let Ti be the set of all (v\,. . . ,ve) G B n (0,p) e such that 
vi, . . . ,V£ are linearly independent and |span(wi, . . . ,vg) fl B n (0,pY\ > L. Let T = U^logfi+i) ^ 

For each v = (vi, . . . , vg) £ J 7 , let {v} denote the set {v\, . . . , vi}. 

We now bound A. Notice that if \B n {x,p) Pi C\ > L, then there must be some v € T for which 
B n (x,p) C\C D x + {v}. Indeed, we can simply take v to be a maximal linearly independent subset 
of (B n (x,p) n C) + x if this set has size at most L + 1, and any linearly independent subset of 
(B n (x,p) n C) + x of size L + 1 otherwise. 

Therefore, by the union bound, 



A^VPr[B fl Mnn3; + {v}] (2) 
* — C,£ 

= £Pr[fl n (0,p)n(C + x)D{v}] (3) 

vG-F 

<V;Pr[B n (0,p)n(C + {0,a:})2{v}] (4) 
veF 

= £Pr[B ft (0,p)nC*D{v}], (5) 

vgF 

where C* is the code C + {0, x} which is a random i?n + 1 dimensional subspace. 

The last probability can be bounded as follows. By the linear independence of v\,...,vi, the 
probability that Vj € C* conditioned on {i>i , . . . , C C* is precisely the probability that a given 

point in a n + 1 — j dimensional space lies in a Rn + 1 — j dimensional subspace, and hence this 
conditional probability is exactly 2 Rn+1 ~ n . We can hence conclude that 

P^*2{v}] = (— . (6) 



1 We could even replace the 2 n by 2 " fl ' n . Indeed, for every C for which there is a "bad" £, we know that there 
are 2 Rn "bad" x's (the translates of x by C). 
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Putting together Equations (5) and (6), we have 

L+i 

A^Yl Pr[Sn(0,p) PC* D {v}] ^ E E 2 {v}] 

ve.F <=log(i+i) veJ, 

W / 2 fln+i y ^ ^ / 2 fln+l 

£=log(L+l) vGJ^ V 7 £=log(L+l) V 



We now obtain an upper bound on \J-i\. We have two cases depending on the size of i. 

• Case 1: £ < 4/e. In this case, we notice that ^ 7^)p * s a l° wer bound on the probability that 
£ points Xi, . . . ,Xj> chosen uniformly at random from B n (0,p) have |span({Xi, . . . ,X^}) D 
B n (0,p)\ > L. Since L > C ■£, Theorem 3 tells us that this probability is bounded from above 
by 2~ 5n . Thus, in this case \T e \ < \B n (0,p)\ e 2- 5n < 2"^^ • 2~ 5n . 

• Case 2: £ ^ 4/e. In this case, we have the trivial bound of < |S n (0,p)| £ < 2 nlH{ ^\ 
Thus, we may bound A by: 

L 4 / £ J /r,R n +l\ e L /r > Rn+l\ e 

a < £ wi • (V) + E wi ' (V) 

^=logL V 7 [4/e] V 7 

^ 2 nm ^2- bn ( - ) + E 2 n£H{p) (- ) 

£=logL V 2 / £=\4/e~\ V 2 / 

<; 2 ~ 5n ■ 4/e + L ■ 2"( en H 4 / £ ) 
< 2~ 5n • 2~ n 

as desired. □ 



4 Proof of Theorem 3 

In this section, we prove Theorem 3 which bounds the probability that the span of £ random points 
in B n (Q,p) intersects B n (0,p) in more than C ■ £ points, for some large constant C. We use the 
following simple fact. 

Lemma 7. For every p £ (0, 1/2), there is a 5 P > such that for all large enough integers n and 
every x £ FJJ, the probability that two uniform independent samples w\,W2 from B n (0,p) are such 
that w\ + ui2 £ B n (x,p) is at most 2~ s P n . 

Sketch of proof. The point w\ + W2 is essentially a random point in B n {0,2p — 2p 2 ). The 
probability that it lies in the smaller ball B n (x,p) is easily seen to be maximal when x = and is 
then exponentially small. □ 



S 



Theorem 3 (restated) For every p G (0,1/2), there is a constant C > 0, such that for all n 
large enough and all £ = o(y/n), if X\, . . . ,Xf are picked independently and uniformly at random 
from B n (0,p), then 

Pr[|span({Jfi,...,X / })nS n (0,p)| > C ■ £] ^ 2" 5n . 



Proof. Set L = C ■ £ and let c = 2. Let 6 P > be the constant given by Lemma 7. Let 
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l ^ L 
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1 
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> - log — 
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For a vector u G F|, ^ -^u denote the random variable ^ UiXj,. 

We begin with a claim which bounds the probability of a particular collection of linear com- 
binations of the Xi all lying within B n (0,p). At the heart of this claim lies the Ramsey-theoretic 
Lemma 5. 

Claim 8. For each S C F| rafA |5| = L + 1, 

Pr[W £S,X V £ B n (0, P )} < 2 n ■ 2- & f dn . (7) 

Proof. Let ui and V\, ... , 1;^ 6 S be as given by Lemma 5. That is, t>i + to, t>2 + u>, • • • , Vd + w is an 
c-increasing sequence. Then, 

Pr[Vv G <S, X v G B n (0,p)] < Pr[Vj G [d], X„. G 5„(0,p)] (8) 

= Pr[Vj G [d],X Vj + X w G !>)] (9) 

= Pr[Vj G G B n (X w ,p)} (10) 

We now bound the probability that there exists y G F 2 such that for all j G [<i], X Vj+w G B n (y,p). 
Fix y G FJ;. We have: 

d r 3-1 -I 

Pr[Vj G [d],X v . +w G fl„(i/,p)] < J] Pr X Vj+w G B„(y,p) | (X t : t G ((J suppfa + w)) (11) 



i=l 



(12) 



The last inequality follows from applying Lemma 7 with and u>2 being vectors X^ and Xi 2 , where 
ii,i2 are two distinct elements of supp(t>j+w)\^|J]~ 1 1 supp(t>j + w)j , and x = y+Y2k^[e},k^{i 1 ,i 2 }^ v j + 
w)kXk. Taking a union bound of Equation (12) over all y G F 2 , we see that 

Pr[3y G F 2 n s.t. Vj G [d],X Vj+w G B n (y,p)] ^ 2 n • 2~^ nd . 

Combining this with Equation (10) completes the proof of the claim. □ 

Given this claim, we now bound the probability that more than L elements of span({Xi, . . . , X{\) 
lie inside B n (0,p). This event occurs if and only if for some set S C F 2 with \S\ = L + 1, it is the 
case that Vt? G S, X v G B n (0,p). Taking a union bound of (7) over all such S, we see that the 
probability that there exists some SCFj with \S\ = L + 1 such that Vu G S,X V G B n (0,p) is at 
most 2^ i+1 ) • 2 n ■ 2~ S P dn . Taking C to be a large enough constant so that d ^ \ log § > the 
theorem follows. □ 
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5 Proof of Lemma 5 



In this section, we will prove Lemma 5, which finds a large c-increasing chain in some translate of 
any large enough set SCFj. 

We will use the Sauer-Shelah Lemma. 

Lemma 9 (Sauer-Shelah [Sau72, She72]). For all integers £,c, and for any set S C {0,1}^, if 
\S\ > 2£ c ~ 1 , then there exists some set of coordinates U C [£] with \U\ = c such that {v\u \ v E 
S} = {0,l} u . 

Lemma 5 (restated) For all positive integers c,£ and L ^ 2r, the following holds. For every 
S C F| with \S\ = L, there is aw E F| such that S + w has an c-increasing chain of length at least 
I(log^)-(l-i)(logf). 

Proof. We prove this by induction on £. The claim holds trivially for £ ^ c, so assume I > c. 

If L ^ 2£ c ~ 1 , then again the lemma holds trivially. Otherwise, by the Sauer-Shelah lemma, we 
get a set U of c coordinates such that for each u E F^, there is some »£S such that v\u = u. We 
will represent elements of F| in the form (u, v') where u E F^ and v' E F^^. 

Let uq E F^ be a vector such that \{v E S \ v\u = uq}\ is at least L/2 C (we know that such a u 
exists by averaging). Let S' C be given by S' = {vUmn \ v\u = u}. By choice of u, we have 

\S'\ L/2 C . 

By the induction hypothesis, there exist w' E ^2~ C ano - , • • • , £ S' such that for each 

3 G 



supp(«j- + to') \ (IJ su pp(fi + w'; 



> c. 



i=l 



for d' > i log(L/2 c+1 ) - (1 - i) log(^ - c). 

Let d = d' + l. Note that d > ~ log(L/2) - (1 - ±) log(^ - c) ^ ± log(L/2) - (1 - \) logl For 
i E [d'], let Uj = (uo,^) E F|. Let t?d be any vector in S with {vd)\u = ~~ , 'Uo> the bitwise complement 
of uq. Let u; = (no, w'). We claim that w and . . . satisfy the desired properties. 

Indeed, for each j E [df], we have 



J- 1 



supp(uj + u>) \ (JJ supp( 



fj + to 



1=1 



supp(^ + it/) \{[) supp(u- -I- u/) 



i=l 



> c. 



Also 



'd-1 



supp(u rf + to) \ ( (J supp(^ + io) 



> |supp(^ + u;)\(M\f/)| = =c. 



Thus for all j E [d], we have |supp(uj + w) \ (Ui=i su PP(f« + w )) 



^ c, as desired. 



□ 
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6 Larger alphabets 

As mentioned in the introduction the case of q-ary alphabet is nearly identical to the case of binary 
alphabet. We only highlight the differences. As before, the crux turns out to be the problem of 
studying the weight distribution of certain random constant-dimensional codes. 

Theorem 10 (q-axy span of random points in Bn(0,p)). For every prime-power q and every 
p € (0, 1 — 1/q), there is a constant C q > 0, such that for all n large enough and all I = o(y / n), if 
X±, . . . ,Xj> are picked independently and uniformly at random from Bn(0,p), then 

Pv[\sp a n({X 1 ,...,X e })nBU0,p)\>C q -£]^q- 5n . 



The proof of Theorem 10 proceeds as before, by bounding the probability via a large c-increasing 
chain. The c-increasing chain itself is found in an analog of Lemma 5 for q-ary alphabet. We first 
need a definition. 

Definition 11. A sequence of vectors v±, . . . ,Vd £ [q] is called an c-increasing chain of length d, 
if for all j £ [d], 

/J-i 

supp(^) \ I |J supp(t 
\i=l 



[Vi 



> c. 



Now we have the following lemma. 

Lemma 12 (q-ary increasing chains Ramsey). For every prime power q, and all positive integers 
c,£ and L ^ q l , the following holds. For every S C Fj with \S\ = L, there is a w £ such that 
S + w has an c-increasing chain of length at least ^ log g (-|) — (1 — \) \og q {(q — 1)1). 



The proof of Lemma 12 needs a non-standard generalization of the Sauer-Shelah lemma to 
larger alphabet described in the next section. 



6.1 A g-ary Sauer-Shelah lemma 

The traditional generalization of the Sauer-Shelah lemma to large alphabets is the Karpovsky- 
Milman lemma [KM78], which roughly states that given S C [q] e of cardinality at least (q — l) l l c ~ l , 
there is a set U of c coordinates such that for every u S [q] u , there is some v € S such that the 
restriction v\u equals u. Applying this lemma in our context, once q > 2, requires us to have a set 
S > 2 e , which turns out to lead to exponential list size bounds. Fortunately, the actual property 
needed for us is slightly different. We want a bound B (ideally polynomial in t) such that for any 
set S C [qY of cardinality at least B, there is a set U of c coordinates such that for every u£ [q] u , 
there is some v £ S such that the restriction v\jj differs from u in every coordinate of U. It turns 
out that this weakened requirement admits polynomial-sized B. 

We state and prove this generalization of the Sauer-Shelah lemma below. 

Lemma 13 (q-aiy Sauer-Shelah). For all integers q,£,c, for any set S C [qY, if\S\ > 2 • ((q — 1) • 
l) c ~ l , then there exists some set of coordinates U C [£] with \U\ = c such that for every u £ [q] , 
there exists some v £ S such that u and v\u differ in every coordinate. 
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Proof. We prove this by induction on I and c. If c = 1, then \S\ > 2 and the result holds by letting 
U equal any coordinate on which not all elements of S agree. 

Now assume c > 1. Represent an element x of [q] as a pair (y,b), where y G [q] e ~ l consists of 
the first £ — 1 coordinates of x and b G [q] is the last coordinate of x. 

Consider the following subsets of [g] £_1 . 

Si = {y G [q] 1 " 1 | for at least 1 value of b G [q], (y, b) G S}. 

5*2 = {y G [q] _1 | for at least 2 values of 6 G [g], (y, b) £ S}. 

Note that |5| ^ (|5i| — 1 1 ) + oiS^I = | jS'i | + (g — l^S^I- By assumption, 

\S\>2- ((g - 1) • ^ > 2 • ((g - 1) • (£ - l))*" 1 + (g - 1) (2 • ((g -!)■{£- l)) c " 2 ) , 

(using the elementary inequality l c ~ l ^ {£ — 1) + (•£ — l) c ~ 2 )- Thus, either |5i| > 2 • ((g — 1) • 
(£ - l)) 0-1 , or else |5 2 | > 2 • ((g - 1) ■ (£ - l)) c " 2 . 

We now prove the desired claim in each of these cases. 

Case 1: |5i| > 2 • ((g — 1) • (£ — l)) c_1 . In this case, we can apply the induction hypothesis to Si 
with parameters £ — 1 and c, and get a subset of U of [£ — 1] of cardinality c. Then the set U has 
the desired property. 

Case 2: > 2 • ((g — 1) • {£ — l)) c ~ 2 . In this case, we apply the induction hypothesis to S2 with 
parameters £ — 1 and c — 1, and get a subset £7 of [£ — 1] of cardinality c — 1. Then the set [7 U {£} 
has the desired property. Indeed, take any vector u G [g] f/u ^. Let u' = u\jj- By the induction 
hypothesis, we know that there is a v G S2 such that v\u differs from u' in every coordinate of U. 
Now we know that there are at least two b G [g] such that (v, b) G S. At least one of these b will be 
such that (v, b) differs from u in every coordinate of U U {£}, as desired. □ 

In the next section, we use the above lemma to prove the Ramsey-theoretic g-ary increasing 
chain claim (Lemma 12). 



7 Proof of g-ary increasing chain lemma 

In this section, we prove Lemma 12, which we restate below for convenience. 

Lemma 12 (restated) For every prime power q, and all positive integers c,£ and L ^ q e , the 
following holds. For every S C with \S\ = L, there is a w G such that S + w has an 
c-increasing chain of length at least ^ \og„(^) — (1 — \) log„((g — 1)^). 

Proof. We prove this by induction on £. The claim holds trivially for £ ^ c, so assume £ > c. 

If L ^ 2((g — 1) • £) c ~ 1 , then again the lemma holds trivially. Otherwise, by Lemma 13 we get a 
set U of c coordinates such that for each u G Fj7, there is some v G S such that v\u differs from u in 

every coordinate. We will represent elements of F^ in the form (tt, v') where u G ¥^ and v' G . 
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Let uq G be a vector such that \{v G S \ v\jj = uq]\ is at least L/q c (we know that such a u 

exists by averaging). Let S' C ¥^ U be given by S' = {vUmn \ v\u = u}. By choice of u, we have 
\S'\ L/q c . 

By the induction hypothesis, for 

d ^^ l0g (2^)-( 1 -^) l0g((9 - 1)(£ - c)) ' 
there exist w' G F^ _c and ^ , . . . , v^/ G 5" such that for each j G [d'] , 



J- 1 



supp(vj +w')\(\J supp(t>- + w')j 



i=i 



> c. 



Let d = d! + 1. Note that 



0-log ? (- 



1 



log_((5 - 1)£) . 



For i G [d!], let = (no,u|) G F^. Let be any vector in S where (vd)\u differs from no in every 
coordinate of U. Let w = (—no, w'). We claim that w and v%, . . . , vj, satisfy the desired properties. 

Indeed, for each j G [d'], we have 



J- 1 



swpp(vj + w) \({J supp( 



Vi + w 



1=1 



supp(«j- + w') \ (1J SU PPK + w '\ 



1=1 



^ c. 



Also, 



a— ± 

supp(v d + io) \ ((J supp( 



+ u; 



i=l 



Thus for all j G [d], we have 



J- 1 



supp(v d + w)\([£]\U) =\U\=c. 



supp(wj + w) \ ( supp(vj + w) 



i=l 



> c, 



as desired. 



□ 



Given Lemma 12, the proof of Theorem 10 is virtually identical to the proof of its binary analog 
Theorem 3. Theorem 6 can then be proved (using Theorem 10) in the same manner as Theorem 2 
was proved. 
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